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(57) ABSTRACT 

A computer system provides streaming media to a plurality 
of clients over a network. The system includes a proxy 
module that forwards streaming media from a first streaming 
media source to a network server module that is communi- 
cating to the plurality of client terminals. The proxy module 
is comunicatable with the network server module to be 
signaled a switch request. In response to the switch request, 
the proxy module forwards streaming media from a second 
streaming media source to the network server module while 
the network server module is signaling streaming media 
from the first streaming media source to the plurality of 
client terminals. 
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VIDEO AND AUDIO STREAMING FOR 
MULTIPLE USERS 

CROSS REFERENCE TO RELATED 

APPLICATIONS 5 

This continuation-in-part appliction claims priority from 
the U.S. patent application Ser. No. 09/001,850, filed Dec. 
31, 1997, entitled Video And Audio Streaming For Multiple 
Users, which claims priority to U.S. Provisional Patent 
Application No. 60/034,128, filed Dec. 31, 1996, both of the 10 
aforementioned applications arc herein incorporated by ref- 
erence. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention is 
This invention relates to the field of network delivery of 

audio and video information. In particular, the invention 
relates to a system for delivering audio and video informa- 
tion to multiple users. 

2. Background Information 

The Internet enables many different ways of communi- 
cating. Originally, the Internet was used for the exchange of 
files and electronic mail. As the capabilities of the Internet 
expand, other types of communications are enabled. ^ 

Audio and video transmissions are an important area of 
the communications that the Internet enables. For example, 
many technologies support the transmission of digital video 
and/or audio signals over the Internet An example of such 
a technology is Quicktime™, available from Apple 30 
Computer, Inc., of Cupertino Calif. Quicktime movies are 
files that can be transmitted across the Internet Quicktime 
provides both audio and video displays. Many other file 
formats allow audio and video to be displayed on people's 
computers. 35 

This paragraph describes an example use of a the Quick- 
time technology. A user will have a browser application that 
resides on his/her computer. The computer, acting as a client 
under the direction of the browser application, will connect 
to various World Wide Web (web) servers. Each web server 40 
will typically serve hypertext markup language (HTML) 
files to the clients. The files may include text, graphics 
references, and references to specialized files. Some of these 
specialized files can include audio and video information in 
Quicktime form. The clients can then play these audio and 45 
video files once they are downloaded using a Quicktime 
plug-in, a helper application, or Quicktime capabilities built 
into the browser application. A plug-in and a helper appli- 
cation are described in greater detail below. 

Streaming audio and video, as a subset of all the types of 50 
audio and video that can be transmitted over the Internet, 
allow people to broadcast long and/or live video and audio 
transmissions across the Internet. Streaming video and audio 
is video and audio digital data that is transmitted on a 
continuous basis. A client can access the data stream and 55 
regenerate the video images and audio signal as they are 
being transmitted. Streaming technology is particularly 
helpful where the events are live, or where the files would 
be so large as to be a burden on the end users. Examples of 
where streaming technology is particularly useful are for the 60 
display of conferences, sporting events, radio broadcasts, 
television broadcasts, and the like. 

RealNetworks, Inc. of Seattle, Wash., provides a system 
for transmitting streaming audio and video signals to users 
over the Internet. RealNetworks supplies a server that allows 65 
multiple users to simultaneously receive streaming audio 
and video. 



The real audio system requires that not only the client 
have additional software, but that the content provider have 
a separate server from their normal web server. For a client 
to receive a real audio broadcast, the client typically con- 
nects through their browser to a Web page with a reference 
to a real audio server. The client then accesses its separate 
real audio player program. The real audio player program 
then connects to the referenced real audio server. A signifi- 
cant drawback to such an arrangement is that the user must 
download the real audio player program. This program must 
then be installed on the user's computer. This may cause a 
number of problems for the user. For example, if the user is 
behind a firewall, or some security program, the client may 
not be able to receive the broadcast from the server. 
Additionally, the installation of any program may have 
conflicts with other programs. The program has the disad- 
vantage of being platform specific. This means that a dif- 
ferent program must be developed and downloaded for each 
type of computer that is to be used to access RealNetworks 
broadcasts. Additionally, the broadcasters of the streaming 
audio and video need to use the RealNetworks server, which 
is separate from the broadcasters' World Wide Web server 
(also referred to as the web server). This increases the 
broadcasters' security problems because now the broadcast- 
ers must be concerned with two separate servers. 

Another example of a video and audio system that uses 
Internet like communications is the MBone. The MBone is 
a specialized communication network that allows for the 
distribution of streaming video and audio signals to multiple 
users. A specialized network is set up specifically to transmit 
MBone communications. A significant drawback of this 
system is that users must be connected to the specialized 
network. Additionally, users will be required to have spe- 
cialized software on their computers to listen to and watch 
MBone transmissions. 

A streaming video system, not requiring a user to down- 
load a separate program, was developed for a single user by 
John Graham of California. This single user broadcast 
technology allowed a web server to serve a single streaming 
video signal to a single client. Although the user did not need 
to download a plug-in to see the video, only one user was 
allowed to access the video stream at a time. In this system, 
video information was captured from a video camera and 
digitized. The digital video information was then encapsu- 
lated in a MIME encoded multipart data stream. The client 
received this data stream and reconstructed frames of the 
digital video. 

Therefore, what is desired is a platform independent video 
and audio streaming system that does not require the user to 
download additional programs beyond the functionalities 
found in a browser. 

1. A SUMMARY OF THE INVENTION 

A system and method of providing streaming audio and 
video data to multiple users is described. In one 
embodiment, the system comprises a first client, a second 
client and a server. The first and second clients are executing 
browsers. The server can communicate with the two clients. 
The server concurrently provides streaming audio and video 
data to both of the clients. Importantly, the server does not 
require the two browsers to use a plug- in or a helper 
application to receive and use the streaming audio and video 
data. 

In some embodiments of the invention, a browser causes 
a client to request an HTML file from a web server. The 
client receives the HTML file. The HTML file includes an 
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HTML tag that directs the browser to load one or more Client: a computer, process, program, or combination of 

applets from the server. The browser executes the applets computers, processes or programs, that can communicate 

causing the browser to request streaming audio and video with a server. 

from the web server. That request may or may not include Seiver a ^mputer, procesSj program, or combination of 

parameters giving information about the type of request s computers, processes or programs, that can communicate 

being made. The web server associates a server process with wilh a clienU ^ and the client caD be executing on 

the request, given the parameters in the request. The web lhc samc compu tcr(s). 

server notifies real-time audio and video process that stream- „_ , c A . lTi . , 

j* j j • c_ j j t * *u Web server: a server for serving at least Internet related 

ing audio and video information is needed. In response to the „ ^ TT __ ^ T 

notification, the real-time audio and video process stores ,„ re < ueste - , Ex *^L e web s fl ers *™h™l pages in 

encoded audio and video data in a shared memory location. res P 0Dse t0 H™^""**™ S ° mC ^JSS? 

rp- ;i i j . . can serve many different kinds of requests, e.g., HTTPS, 

The server process accesses the shared memory and inserts ,,., p J ^ ' & ' 

the audio and video data into one or more data streams. The an 

client receives the data streams and reconstructs the audio Browser: an application, program, process, or combina- 

and video signals using only the capabilities of the browser. 1S ^ of a PP ucations > programs or processes, that allow a 

In some embodiments, a separate stream and server process clieal 10 make a rec l uest of a web server and process the 

is used for each of the audio and video data. These embodi- results of me request. The browser may be part of a stand 

ments allow multiple clients to simultaneously receive the alone application or a set of programs that are integrated into 

same audio and video data. lhc operating system of the client. 

Other embodiments of the invention include a web server 20 Plug-in: plug- ins are external software programs that 

that can serve streaming audio and video information as well extend the capabilities of the browser in a specific way. For 

as perform more usual web server functions (such as, example, a plug- in can be used to give the browser the 

serving web pages, performing file transfers, supporting ability to play audio samples or view video movies from 

secure communications). These embodiments have the within the browser. 

advantage of allowing the broadcasters and the users to set 25 Helper application: like plug-ins, helper applications are 

up their security configurations for one web server, rather external software programs. The browser redirects some 

than two servers (a web server and a streaming audio and types of file to the helper applications. The helper applica- 

video server). tions allow clients to process many different types of files on 

Although many details have been included in the descrip- the Internet. When the browser encounters a sound, image, 

tion and the figures, the invention is defined by the scope of 30 or video file, the browser hands off the data to the helper 

the claims. Only limitations found in those claims apply to applications to run or display the file, 

the invention. JavaScript: a stand-alone programming language built 

2. A BRIEF DESCRIPTION OF THE DRAWINGS into m ™y browsers. Primarily an extension to the Internet 

- , standard HTML language. 

The figures illustrate the invention by way of example, 35 . . , „ . 

and not limitation. Like references indicate similar elements. J > va : a P^wmmg language whose programs (called 

. uj- . r applets) can travel over the Internet for use by clients. 

FIG. 1 illustrates a system including one embodiment of qs and he are ^ 0lGd for a 

a streaming audio and video system for multiple users where ^ Qf dfe Jaya ^ ^ worfc acf0SS 

client computers do not need plug-ins or helper programs. ^ lmmt (* e ta of the lype of dienL Many browse rs 

FIG. 2 illustrates an example method of streaming audio 40 inc|ude Java ^ Java applets require no instal- 

and video for multiple users. lation Except where QOtedj Java and j aV aScript are inter- 

FIG. 3 illustrates a web page that a user can use to access changeable, 
a streaming audio and video broadcast. 

FIG. 4 illustrates a web page for selecting the bandwidth (b) System 

of the user's Internet connection. 45 _ „ .„ . , , ,. A c 

T-t^ * mi . . u 1.* . a- a FIG. 1 illustrates a system including one embodiment of 

FIG. 5 Ulusua.es a web page having streaming aud.o and ^ ^ ^ supp|ie(J ovef ^ 

V1 ^. . a.* , ^ , % ... 4 - Internet to multiple users. The following paragraphs first list 

FIG. 6 is a block diagram under another embodiment of ^ elementfi Qf ^ Q x descfibe ^ mterconnectioos> and 

the invention, illustrating a proxy switching system so lhen descfibe ^ yarious dements m detail 

FIG. 7 is a flow chart for a process to use proxy switching ^ ^ clemems q£ nG L nG j 

for providing streaming media to client terminals, under an M J a s £J m having three parts: a client side m a 

embodiment of the invention. communications interface 180, and a server side 130. The 

3. THE DESCRIPTION client side 100 includes a client 112 and a client 111. The 

The following sections describe embodiments of the 55 client 112 includes a browser 102 having a video display 

invention. The first section provides definitions that will help area 103 - ^ clieDt 111 chides a browser 108 and a video 

in the understanding of the remaining sections. The second display area 104. The communications interface 180 

section shows an example system that supports various includes the Internet 185. The server side 130 includes a web 

embodiments of the invention. The third section describes an server 131 > a shared memory 135 > a real-time server 

example method of using the invention. The fourth section 60 14 °. The wcb server 131 includes two processes, a process 

illustrates an actual use of the streaming audio and video 138 and a P rocess 139 - ^ real-time server 140 includes a 

used in some embodiments of the invention. The last section v i dco module 144, an audio module 146, a video proxy 148, 

reviews additional alternative embodiments of the invention. and an ™ dio P rox y 149 - real-time server 140 interfaces 

with a number of other elements. These elements include a 

(a) Definitions 65 video card 159> an mpul aud i 0 interface 162, and an HTTP 

The following definitions will help in the understanding connection to remote server 170. Various elements of FIG. 

of the following description. 1 have now been listed. 
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The following paragraphs describe the interconnections Similarly, the input audio interface 162 allows for the 

between the elements of FIG. 1. Beginning on the server side input of analog audio signals and converts this input to 

130, the video card 159 receives a video input 158 outputs digital audio signals. What is important is that the audio 

a digital video signal to the video module 144. Similarly, an module 146 receives a digitized audio signal that can be used 

input audio interface 162 receives a mike input 164 and/or s by the real-time server 140. The audio module 146 may 

a line input 166 and outputs a digital audio signal to the convert me digitized audio signal into any of a number of 

audio module 146. The HTTP connection to remote server formals > corresponding to any of a number of audio trans- 

170 receives a streaming audio and video data 175. Tne missl0U rates (examples include G.711 and G.723 audio 

HTTP connection to remote server 170 outputs the video compression tormats). 

data to the video proxy module 148 and the audio data to the 10 ™* HTTP connection to remote server 170 represents an 

audio proxy module 149. The real-time server 140 uses the important advantage of one embodiment of the invention. In 

data received by the various modules and stores portions of lhis embodiment, the HTTP connection to remote server 170 

that data in the shared memory 135, after some manipulation aUows * c Sldc 130 to forward broadcasts of audio 

of the data. The shared memory 135 is accessed by the web and video si S nals from other streaming audio and video 

server 131. The process 138 and the process 139 transmit is scrvcrs * In mc t*™ Sldc 130 ac,s " a clicnt t0 

and receive data to the communications interface 180. Thus, another aa^r. ^ HTTP connection to remote server 170 

the couplings of the server side 130 have been described. In can receive and audio bcm S broadcast trough 

some embodiments, the process 138 and the process 139 me Inlernet 185 from another Mlver - ^ connection 

correspond to HTTPD processes. 10 remole ^ 170 provides the digital video information 

_ . . . f -.OA ii ■ i • -j nn from the other server to the video proxy module 148. 

The communications in erface 180 allows the client side » ^ ^ HTrp connec[iQn ^ rem0 , e m m 

100 to communicate with the server side 130. The commu- vk)es ^ audio data to ^ mdio mMk ug ^ 

nications interface, and the Internet 185 in particular, sup- yideo module 14Jj ^ ^ mdio proxy module 149 

port many difiFerent types of connecUons by the client side tben * ^ ^ yideo and data to the 

100 and the server side 130. In the example communications real-time server 140 

interface 180. the communications interface 180 includes 25 _ ,. ' . i- 

the Internet 185. In particular, in this example, the process The rea -time server 140 represents an application, or se 

138 is communicating streaming audio and video data 176 of ^cations, executing on one or more computers that 

*~ t„*™^ ice c;„;i«,i. t tuL ™o no ™ mT „„ n ; prepares audio and video data for broadcasting to multiple 

to the Internet 185. Similarly, the process 139 is communi- v v . t t . , I** 

iL . . \ * j j * 1 to « iL r t . users through the web server 131. The real-time server 140 

catuig the streaming audio and video data 178 to the Internet , unuu & u u 

fa & 3Q x&es tne data from the various modules, processes the data, 

and stores the processed data in the shared memory 135. The 

On the client side 100, the client 112 is communicating rea l-time server 140 can perform compression, and other 

the streaming audio and video data 176 with the Internet manipulations of the data, to reduce the processing burden 

185. Similarly, the client 111 is communicating with the Qn me web sefver m For examp ie, m embodiments 

Internet 185 to receive and manage the streaming audio and of the invcnlion> lhe rca l-time server 140 receives digitized 

video data 178. The clients then communicate the informa- vidcQ daU and coropresses that dala mt0 jp E G images, 

tion to their respective browser applications. The browser JpEG imagcs afC sconced digita i frames 0 f v id co . 

applications the generate video images in their respective Sim iia r ly, for the audio data, the real-time server 140 breaks 

video display areas. lhe audio information into one-half second time periods of 

Thus, the connections between the various elements of ^ aud i 0 data (other embodiments use other time periods). 

FIG. 1 have been described. Now the various elements will These one-half second time periods of data are stored in the 

be described in greater detail in the following paragraphs. shared memory 135. The real-time server 140 can also 

An example method of using these elements is described compress the audio information into one of a number of 

below in relation to FIG. 2. various compressed audio signals (e.g., G.711 and/or G.723 

The server side 130 will be described first. 45 audio compression formats). In some embodiments of the 

The video input 158 represents a video signal that a user invention, the real-time server can broadcast audio and video 

of such a system wishes to broadcast to the clients on the ^om multiple sources to multiple clients, 

client side 100. The video input 158 can include analog The shared memory 135 represents a shared storage area 

signals representing video information. The video card 159 for use by the real-time server to store audio and video data 

digitizes the video input 158 to produce a digital video so for access by the web server 131. In one embodiment the 

image. Various embodiments of the invention include Sun shared memory 135 has a locking and semaphore usage 

video cards available from Sun Microsystems, of Mountain scheme to ensure that the real-time server 140 is not writing 

View, Calif., and Parallax X Video Xtra™ video cards, data into the shared memory 135 while the web server 131 

available from Parallax Graphics, Inc., of Santa Clara, Calif. is accessing that data. In some embodiments, the sema- 

However, what is important is that the real-time server 140, 55 phores act as notifiers to indicate that new data in the shared 

and in particular the video module 144, receives some sort memory 135 is available for use by the web server 131. In 

of digitized video signal. The video module 144 is respon- some embodiments, the video data and the audio data are 

sible for providing the real-time server 140 with the video stored in different shared memory locations, 

information that will be broadcast to the client side 100. The The web server 131 communicates data over the Inlernet 

video module 144 can convert the digitized video signals to 60 185 using one or more communications protocols. In some 

be of better use to the rest of the system. For example, the embodiments of the invention, these protocols include 

video module 144 may, if not done by the video card 159, HTTP (Hypertext Transfer Protocol), TCP (Transmission 

convert digital video data into a sequence of JPEG digital Control Protocol) and UDP (User Datagram Protocol). The 

video frames. In any case, what is important is that the web server 131 represents an application, including one or 

real-time server 140 receives digital video information in a 65 more processes, for communicating over the Internet 185. In 

format that it can use (example formats include, JPEG, one embodiment, the web server 131 includes an Apache 

MPEG, GIF, and AVI). web server. Each of the processes in the web server 131 
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represents one or more processes for serving streaming The browser application 102 is responsible for receiving 

audio and video data to the client side 100. In some the streaming audio and video data 176 and reconstructing 

embodiments, the web server 131 transmits the video data as an audio and video signal suitable for the end user. In this 

a multipart MIME (multi-purpose Internet mail extensions) example, the video display area 103 displays the recon- 

encoded file for decoding directly by the browser or as 5 structed video information received from the video input 

compressed video information for decoding by an applet run 158 at thc r0 aJ-Limc server 140. Similarly, the client 111 is 

in the browser. The web server 131 transmits the audio data executing the browser 108. The browser 108 is displaying 

as compressed audio data for decoding by an applet run in mc Mmc signal m mc display arca 104 

the browser. client 111 represents another computer executing a browser 

In some embodiments, the web server 131 initiates a 1Q ^^^00. 

separate process for each audio and video connection made ... . „ f .. • « j-c *• 

from client side 100. Tins, for one client receiving stream- Canons embomments of the mvention have modifications 

ing audio and video data, two processes would be started '° the system shown ui FIG 1. Some of these variations are 

within the web server 131. Hie first process would supply described in this paragraph. For example, the client 1U and 

video data and the second process would supply audio data. s *>* client 112 can be the same computer or be different 

The processes access the shared memory 135 and serve the 15 computers. The clients can be on the same local area 

data across the Internet to the respective client. 5*'™* ° r u be ° n completely different local area networks. 

... . . „. . ... , .i . There can be many more clients receiving the information 

In some embodiments, the web server 131 initiates at least from ^ ^ ^ m Additionall M shown ^ the 

one process for each client. This provides important advan- HTTP connection to remote server 170, a real-time server 

tages in some embodiments of the invention. In particular, on t . n . 1ftn . -* ta in 

L & . , . • tl _ j . j- *i 20 140 can appear on the chent side 100 to distribute data to 

because the web server 131 is serving the data directly clients 

through processes it created, server side 130 users need not o er c e . 

worry about security issues beyond those already faced with . Note that Prions of the system, and embodiments of the 

their web server 131. Thus, these embodiments of the invention, are sets of computer programs or computer that 

invention have a lower chance of interfering with client side „ can be stored on computer usable media such as floppy 

100 fire walls and have a lower chance of having a server 25 disks > hard dnvcs > CD R0Ms > Zl P disks ' ctc ' 

side 130 security problem. Thus, an example system supporting streaming audio and 

Other embodiments of the invention include separate video data for mulli P le has been Ascribed. 

Common Gateway Interface (CGI) programs for audio and ^ £ xam pi e Method 

video. These CGI programs are used by the web server 131 30 

to serve the streaming audio and video data. These CGI FIG- 2 illustrates one example of a method of broadcast- 
programs are not necessarily integrated as tightly to the web ing streaming audio and video data to multiple users. This 
server 131 as the process 138 and the process 139. However, example method could be executed on the system of FIG. 1. 
a CGI program allows for the easy extension of many In this example, the client 112 will initiate a request to 
different types of web servers. « receive streaming audio and video data 176 from the server 
The communications interface 180 permits communica- *J 13 »- ™ e ^ 112 will display the video data in the 
tions between the server side 130 and the client side 100. Id video display area 103 and will play the audio data for the 
this example, the Internet 185 supports the communications. ™[ Importantly, the client 112 can play audio and video 
Other embodiments of the invention support other commu- ™ th ° ut the need of a plug-in or helper application. As wil 
nications interfaces. For example, the Internet 185 can be 40 bc shown ; th e audio and vtdeo play as part of a transparent 
replaced by a local area network, a wide are network, a P rocess of the cliem m loadin 8 a web P a S e from me 
proprietary telecommunications and networking 1^1. 

infrastructure, or some other communications interface. At block 210, the client 112 initiates an HTTP request 

What is important is that the server side 130 can commu- from the web server 131. This could be the result of the 

nicate with the client side 100. The communications inter- 45 browser 102 receiving and displaying an HTML (hypertext 

face 180 can also include combinations of the above markup language) page including a link that will initiate 

described technologies. For example, the Internet 185 can streaming audio and video. The user would have selected 

include a web server to which the clients on the client side this link which will then result in the browser 102 making 

communicate through to access the Internet 185. The chent the connection to the web server 131. 

side 100 can be on a local area network that is connected 50 As a result of the connection, at block 220, the web server 

through a server, or router, to the Internet 185. 131 supplies a Java applet for decoding audio data and that 

The client side 100 represents the consumers of the will help in the display of video information. These instruc- 

streaming audio and video data. In this example, the two tions could be supplied as two separate Java applets or one 

clients are receiving separated streaming audio and video combined Java applet. 

data signals. Other embodiments of the invention support 55 At block 230, the client executes the Java applets. The 

many more clients. video display portion of the applet initiates a request of the 

The client 112 represents a computer, such as a PC web server 131 for a HTTP transmission of a multipart/ 

compatible computer, running a browser application 102. mixed replace MIME encoded video (or in other 

For video display, the browser application 102 can include embodiments, video data for Java decoding). Also at block 

a Netscape Navigator™ or Communicator™ program for 60 230, the audio Java applet makes a similar request of the web 

"multipart/xmixed-replace MIME type video," or a server 131. The requests can include optional information 

Microsoft Internet Explorer™ 3.0 or later for a Java based such as desired video frame rates or audio rates. The requests 

video transmission. In some embodiments, the Java based include the URI (universal resource indicator) indicating the 

video transmission applet parses the multipart/x-mixed- particular audio or video streaming in formation to be served, 

replace MIME type video. For audio, the browser applica- 65 The following will describe the audio serving by the web 

tion 102 can include any browser that supports Java and/or server 131 and eventual decoding by the client 112. The 

JavaScript. video serving will be described after the audio. 
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At block 240, in response to executing the Java applet, the module 148, and compresses that information into a JPEG 

client makes an audio request of the web server 131. This is image. In some embodiments of the invention, the video 

done through the Java applet which supplies a universal card 159 provides the images as JPEGs. The requesting 

resource indicator to the web server 131. The universal procedure is similar to that followed in the audio request 

resource indicator can indicate the audio stream that is being s block 240. 

requested. This request looks, to the client 112, like a file The real-time server 140, at block 254, writes one JPEG 

download request. The web server 131 responds accordingly frame into the shared memory 135. The process 138 

to this request by beginning to transfer the streaming audio accesses the shared memory 135 to retrieve the JPEG frame 

information. Importantly, the client 112 does not need to and transmit that frame to the client 112. At block 256, the 

know that the file is a streaming audio or video signal that 10 process also formats the JPEG as part of a multipart MIME 

is essentially never ending. encoded file. 

In response to the client request, the web server 131, and \\ block 258, the client 112, using the capabilities of the 

in particular the process 138, makes an audio data request of browser 102, decompresses the video data from the MIME 

the shared memory 135. Note, if the process 138 bad not encoded format, and the JPEG encoded form, and creates the 

been created, the web server 131 creates the process (in 15 v i deo display 103. 

some embodiments, the web server 131 creates a separate Al block 2 si t the web server 131 determines whether the 

process for each of the audio and video data streams). The vidco Java applct ^ ^ requesting video frames. Block 254 

audio data request of the shared memory is done by the web through block 251 are then repeated. The result of these 

server 131, and in particular by the process 138, by notifying blocks ^ ^ mu i t i p i c frames of video information is 

the real-time server 140 that audio information is requested. 20 displayed in the video display 103. Thus, the user has the 

In subsequent iterations, the web server 131 need not make perception of a video display at the client 112. 

the explicit request for the audio information. Once Note, by me time the audio information is played from the 

requested, the real-time server 140 will continue to provide previoils audjo transmissionj a new audio transmission has 

audio information, in these embodiments, until it is told to ^ been receivcd and dccompressed . m e client 112 will 

st0 P* have a continuous audio signal being presented to the user. 

In any case, the real-time server 140, in response to the [f - t [& ^ case ^ ^ audio> Qr the yidf > 0y mform ation is 

request, prepares audio information and writes this infor- nQt bd receiyed b ^ diem m at a suffident data rate> 

mation into the shared memory 135. In various embodi- me OTnespondil|g Java applet , in some embodiments of the 

ments of the invention, the real-time server 140 prepares the mventioD) can requesl a different rate of transmission. The 

audio data by breaking the audio information into time j ava applet can request a lower rate corresponding to a lower 

periods. This audio information is also compressed into audio or video signal, thai wiU more appropriately match the 

various sets of compressed data corresponding to different bandwidlh availability of the client 112. 

audio rates. Higher audio rates correspond to better quality - t . , , . 

, , , j. 4 r t , 4 . One advantage of the system of FIG, 1 is that if the web 

audio signals. In these embodiments of the invention, the wu t " 6 . ? Ut , . . f . „ „ Mt „ • 

real-time server 140 writes the data for the various audio * se ™ r 31 becomes heavrty loaded, the video 

rates to the shared memory 135, thereby reducing the work ™aUcally reduced. This is done by ^ensuring that th 

load of the web server 131. Different web server 131 au *° P rocesses take f™* °™ * e V1 f> P roCeSS f. _ If * 

.„ ..«• # a -» j ^ video process cannot access the shared memory 135 in 

processes will require different audio . r. es depending on P video ^ ^ no , be ^ 

their connections to their respective client. By storing the cd ^ H audio 

mformation corresponding to the different audio rates into * u ' *uZ „.a;* 

. . ,- c & . process should have an opportunity to transmit the audio 

the shared memory 135, each process can access the desired r - . rr J 

audio rate data from the shared memory 135. Thus, the web 1 ° 1 

server 131 need not calculate the compressed audio data for As has been seen by the above discussion, the user has not 

each process within the web server 131. bee » re 1 uired 10 download any plug-ins or use any helper 

™ i - e ... , 1Xi 45 applications in the receiving of the streaming audio and 

The process 138, through the web server 131, now . ..... „ ,. & . tl f . . , , 

.t, a * Af M *u~ *u„~a m o Ji, iic video data. Additionally, the web server 131 is able to 

transmits the data accessed from the shared memory 135. t , . J ,, f l4 . , ,. 4 ^ . 

™. i . «| \ 's a £ execute this example method for multiple clients, bach 

This corresponds to block 246. .. ... j- * f • .u 

r , client would have a corresponding set or processes in the 

At block 248, the client 112 receives the compressed wcb servef m Tfac numbcr of processes ^ only limited to 

audio data. The client decompresses the audio data as 5Q the number of connections that can be supported by the web 

commanded by Java audio applet, and plays the audio seryer m ^ faas been nQtedj some of me worfc ^ would 

information through the audio system of the chent 112. normaUy ^ performed by ^ web server 131 has been 

At block 241, a test is made to determine whether the web moved ^ the jed-iime server 140 to reduce the load on the 

server 131 should continue broadcasting the streaming audio web 

information to the client 112. This test is made by deter- 55 

mining whether the client 112 has broken the connection to (d) Example Video Display 

the web server 131. FIG. 3 through FIG. 5 represent the interface presented to 

The web server will continue serving the data as long as a user using a browser 102 on a client 112. In this example, 

the client 112 is connected to the web server 131 through the the user is using a standard PC with a standard Netscape 

Java audio applet. 6Q Communicator 7 " 4.0 browser application. FIG. 3 includes a 

Note, importandy, the user al the client 112 has not had to browser window 302 with a cursor positioned over a trans- 
download any additional plug-ins or helper programs to play mission selection link 304. The transmission selection link 
the streaming audio information. 304 corresponds to a request for transmission of streaming 

Turning to the video broadcasting, at block 252, the web audio and video data. FIG. 4 illustrates the result of the 

server 131 makes a video information request to the real- 65 selection of the transmission selection link 304. The user is 

time server 140. The real-time server 140 takes each video presented with a number of connection speeds to select 

frame from the video module 144, or the video proxy from. The user selects the speed associated with his or her 
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connection speed to the Internet 185. In this example, the The proxy switching source 635 includes a web server 
user is selecting a Tl or better connection speed. In one 632 to communicate with client terminals and other servers 
embodiment of the invention, the Java applets are control- over the Internet. The proxy switching source 635 may also 
ling the presentation of the various selection speeds. This is function as a streaming media source for client terminals 
shown as a bandwidth selection link 404. s 610. To this end, proxy switching source 635 may include an 
FIG. 5 illustrates the result of the "Tl or higher" band- audio module 636 to receive and digitize audio input for 
width selection link being chosen, A digital video display broadcasting streaming audio media to client terminals 610. 
502 is shown in the browser window 302. The client The proxy switching source 635 may also include a video 
computer executing, the Netscape Communicator browser, module 638 to receive and digitize video input for broad- 
is playing an audio signal corresponding to the digital video 10 casting streaming video media to the client terminals 610. 
display 502. In this example, a user is allowed to modify the The proxy switching source 635 also includes proxy switch- 
video rate, shown in frames per second, by selecting one of ing module 634. The proxy switching module 634 commu- 
the video rate selectors 510. A result of selecting one of the nicates with other servers to receive streaming audio and/or 
various video rate selectors 510 would be that the corre- video media. In particular, the proxy switching module 634 
sponding video Java applet will communicate with its cor- is communicates with web servers 622 of the streaming media 
responding process in the web server 131. The Java applet sources 620A and 620B to receive streaming media via the 
would request a change in the video frame per second rate Internet 605. For proxy switching source 635, shared 
being supplied by the process in the web server 131. memory 631 stores streaming media received from video 
Similarly, a set of audio rate selectors 512 allow the user to module 638, audio module 636, or through media source 
select a higher or lower quality audio signal. The corre- ™ 620A and 620B via proxy switching module 634. The web 
sponding Java audio applet would communicate with its server 632 of proxy switching source 635 transmits stream- 
corresponding process in the web server 131 to request the ing media that is first stored in shared memory 631. 
change in the audio rate. The streaming media sources 620A and 620B each 

/\ajj- ii- uj- . include webserver 622. Each streaming media source 620A, 

(e) Additional Embodiments 25 ^ ^ 1q & ^ module ^ m ^ 

Thus a system for broadcasting streaming video and audio module 626, and a proxy switching module 624. As with 

information to multiple users has been described. However, proxy switching source 635, the audio module 626 receives 

various embodiments of the invention include modifications and digitizes audio input. The video module 628 receives 

and optional additions to the system. and digitizes video input. 

It is possible for the real-time server 140 to be receiving 30 ^ prQxy switchmg mo dule 624 enables sources 620A, 

and transmitting multiple different video and audio signals 620B to each receive streaming audio and video media from 

through the web server 131. Additionally, multiple web othcr sources ( not shown). A shared memory 621 stores 

servers could be accessing the information from the real- streaming media data for web server 622. In this way, an 

time server 140. Additionally, multiple real-time servers 140 embodiment may provide for each source 620A, 620B to 

could be providing information for the web server 131. 35 alternat i ve i y function as proxy switching source 635. 

In some embodiments of the invention, users can select (n an embodiment? administrator 625 is a client terminal 

either the audio stream, the video stream, or both the audio h ■ browscf m The admmistrator 625 may also include 

and video stream from a server. Similarly, some users can a d - . ^ tQ yiew streaming media from ^ ^tcXed 

select one of these sets of streams while other users select soUfce 62fJ , n aQ embodimenlj administrator 625 includes 

other sets of streams. Additionally, some users can select <*o ^ editof iQlerface to xlec{ one of ^ streaming media 

different rates for audio or video information than other SQUrces mA 620B for broadcast l0 clien t terminals 610. 

users. In such systems, the real-time server 140 supplies the For e to the editor interface may display streaming 

data corresponding to the requested rates to the shared audio and videQ ffledia from each S0Ufce 620A ^ 620B 

memory 135. For example, if one user is requesting a first ^ edUor may ^ mclude a selection feature, 

audio rate and a second user is requesting a second audio 45 ^ ^ ^ im . and . dick mechanism or selection icon, to 

rate, the shared memory 135 would store audio data for both cnaMc ^ cditQr of administrator 62S to sclect one of the 

audio rates of compression. In some embodiments, the web streaming media ^wces 620A) 620B for broadcast to client 

server 131 notifies the real-time server 140 when a particular terminals 610 

audio rate is not required by any of the processes anymore. ,..„.'... i 4 r i j- 

M J J r so Initially, the administrator 625 selects, for example, media 

(f) Proxy SvWtching source 620 A. The selection is passed to proxy switching 

FIG. 6 illustrates a system 600 under another embodiment source 635. The proxy switching source 635 establishes 

of the invention. The system 600 enables viewers on client communications with the selected media source 620A. 

terminals 610 to experience streaming media broadcast from When media source 620A is selected by administrator 625, 

multiple sources 620A on a network such as the Internet. 55 toe proxy switching source 635 couples to a channel 617 for 

With system 600, client terminals 610 may be switched receiving streaming media from media source 620A. The 

seamlessly between media sources. Specifically, users of shared memory 631 stores the streaming media from source 

client terminals 610 can be switched between sources of 620A. The streaming media stored in shared memory 631 is 

streaming media without experiencing an interruption that subsequently signaled by web server 632 to client terminals 

would otherwise result from breaking a connection with one 60 610 ( and administrator 625). The web server 632 signals the 

streaming media source 620A to receive streaming media streaming media from the media source 620A to the client 

from another source 620B. terminals 610 on a communication channel 627 available 

In an embodiment, system 600 includes administrator 625 through the Internet 605. 

coupled to proxy switching source 635 across the Internet The administrator 625 may subsequentiy select source 

605. The proxy switching source 635 communicates over the 65 6 20B. A switching control signal is transmitted to web server 

Internet 605 with other streaming media sources 620A and 632 via Internet 605 to signal the switch. The switch control 

620B. causes proxy switching module switches to channel 619 to 
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receive streaming media from source 620B. The shared vided from either administrator 625, or from one of the 

memory 631 then receives streaming media from source client terminals 610. The command is received by the server 

620B. The web server module 632 accesses the streaming 632 of the proxy switching source 635. 

media from shared memory 631. The web server 632 then ^ web xom 632 of the proxy switching source 635 

s.gnals the steaming media from source 62 OB to client s communicates ^ command to switch media sources to the 

terminals 611 loni the communication channel 627, once moduk ^ ^ a)mmand be jn me form of a 

streaming media from source 620A that remainiag in shared . f t . nmw\ i_- i_ * . * »u u 

^, . # * . . j * !• . 4 • i riA m. t, uniform resource locator (URL), which instructs the web 

memory 631 is transmitted to client terminals 610. The web , v £ - A . . . tU 

server 632 does not disconnect or break the connection of server to caus ^ P™* ™f* lt to ™ ich to th ' 

communication channel 627 while proxy server module 634 in ncw ™*a source 620B. Ibe URL scaled as the command 

malcestheswitchfxom S ource620Ato620B.'mewebserver 10 ma ? parameters to specify the switch. One format 

632 seamlessly transmits the streaming media from source for ?. havin S P a ™ ctcrs *> causc to a new 

620B. Hie client terminals 610 maintain their connections raed,a resource 15 as follows: 

with web server 632, and the web server 632 is not inter- www.<hostingserver>.com/<file type>? server -<viewing 

rupted in signaling streaming media after switching to channe number>% source=<sourcelocation>: 

source 620B. Thus, once administrator 625 switches from <portnumber>-<channel number> 

source 620A to source 620B, clients 610 are all seamlessly In the URL illustration, the new media source is provided 

switched together from source 620A to source 620B. The as a new channel to clients 610. 

communication channel 627 between client terminals 610 In step 730, the proxy module switches to a different 

and web server 632 remains intact. The effect is that all of streaming media source. For example, the proxy module 

the client terminals 610 switch streaming media sources switches to receive streaming media from source 620B, 

620A and 620B nearly simultaneously, without an interrup- rather than 620A. 

tion or break in experiencing streaming media. In step 740, one or more of the participants in the audience 

While system 600 illustrates administrator 625 as signal- experience streaming media from the new source If for 

ing a switch to occur from source 620A to source 620B, „ sample, administrator 625 makes the request, then all of the 

other embodiments may provide that one or more of the audience experiences streaming media from the new source, 

chent terminals 610 can signal the switch to proxy switching Alternatively, one of the participants may make an indi- 

source 635. In these embodiments, web server module 632 vidual command, in which case only that client terminal 610 

of proxy switching source 635 receives the switch request * C0U P led t0 receive streaming media from the new source 

from one of the clients 610. That client terminal 610 making 10 620B. .... ™~ ^ ... 

the switch request may be treated as an administrator, in A» 3X1 alternative mentioned with FIG. 6, proxy switching 

which case all of the other clients are switched to the source 635 may be switched to one of the sources 620A or 

requested source together. Alternatively, the client terminal 620B - A command to cause a new host for streaming media 

610 making the switch request may be switched to a new deliver V ma X be provided as a URL with parameters such as: 

source individually. As still another alternative, one or more 35 www.<hostingserver>.com/<file type>7 server =<viewing 

of the client terminals 610 may make the request to switch channel number>% source =www,<newhost> .com: 

media sources to administrator 625. The administrator 625 <portnumber>-<channelnumber> 
then chooses the response to the request. 

In an embodiment shown by FIG, 6, the streaming media <&> Examples of Proxy Switching 

sources 620A and 620B are provided to alternatively func- 40 fa one example, system 600 may provide a virtual 

tion as proxy sources for other streaming media sources. seminar or symposium for an audience of users operating 

Thus, in the example shown, each source 620A, 620B may individual client terminals 610. The speakers of the seminar 

route streaming media from one or more other sources. ma y De recorded in real-time through audio and video 

Further, each of the steaming media sources 620A, 620B digitizers located on terminals or servers, forming streaming 

may act as proxy switching sources, so as to switch between 45 me dia sources 620A and 620B. For this example, it is 

other sources (not shown) feeding media to the proxy assumed that system 600 is operated over the Internet. Since 

modules 624 of the respective sources 620A, 620B. The cacn speaker may be located in a different location, the 

administrator 625 may access the web servers 622 of the media stream resulting from a broadcast by each speaker 

sources 620Aand 620B to cause streaming media received may be directed to proxy switching source 635. When a 

from one source (not shown) by respective proxy modules 50 presentation by one speaker is completed, an administrator 

624 to be switch to another source (not shown). One of the $25 can switch the audience to a new speaker. The switch 

advantages provided by this embodiment is that system 600 maY be made seamlessly from the audience's point of view, 

is scalable, allowing both proxy streaming media delivery eV en though each client terminal comprising the audience is 

and switching on a large scale. located remote from the rest of the audience. The adminis- 

FIG. 7 illustrates a flow process for operating proxy 55 trator 625 may also use the seamless switching to enable a 

switching, using a system such as shown by FIG. 6. In step discussion to occur between speakers. For example, a 

710, an audience is provided streaming media from a first speaker can indicate to administrator 625 a desire to respond 

source. The audience may comprise client terminals 610. to a statement by another speaker. The administrator 625 

The streaming media may include audio media and/or video may then cause the switch to occur, so that the new speaker 

media. The streaming media may originate from proxy 60 can address the audience, before switching back to the old 

switching source 635, or from one of the other sources 620A speaker. The administrator 625 can make the switch without 

and 620B. breaking the connection (communication channel 627) with 

In step 720, a command is provided to proxy switching the audience. As a result, the audience does not experience 
source 635 to switch sources from, for example, source a broadcast interruption when a switch is made to a new 
620A to source 620B. The command may alternatively 65 speaker. In this manner, the virtual seminar can be made to 
request to switch from proxy switching source 635 to either simulate a real seminar, or a closed network analog broad- 
source 620A or source 620B. The command may be pro- cast of a seminar. However, system 600 enables the Internet 
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to be used in a manner that enables the audience and 
speakers to be located remote from one another. 

As another example, a classroom may use system 600 as 
an educational tool. The client terminals may be operated by 
students. The administrator 625 may be a teacher, providing s 
the students with an educational streaming media content. 
The system 600 allows the teacher to use client terminals 
610 to show each student the same streaming media content. 
The teacher may then switch the whole classroom to a new 
streaming media source, rather than require the students to 10 
make the switch independently. 

(h) Conclusion 

The foregoing description of various embodiments of the 15 
invention has been presented for purposes of illustration and 
description. It is not intended to limit (he invention to the 
precise forms disclosed. Many modifications and equivalent 
arrangements will be apparent. 

What is claimed is: 20 

1. A system for providing streaming media to a plurality 
of clients over a network, the system comprising: 

a plurality of streaming media sources coupled to the 
network; 

a network server module that couples to the plurality of 25 
clients to signal streaming media from at least a first 
streaming media source in the plurality of streaming 
media sources to each of the plurality of clients using 
a first channel; 

a switching terminal to signal a switch request to the 30 
network server module, the switch request requesting 
streaming media from a second streaming media source 
in the plurality of streaming media sources; and 

a proxy module that forwards streaming media from the 
first streaming media source to the network server 
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module, the proxy module being communi eatable with 
the network server module to be signaled the switch 
request, and in response to the switch request, the proxy 
module forwarding streaming media from the second 
streaming media source to the network server module 
to facilitate seamless transition on the first channel 
from the first streaming media source to the second 
streaming media source. 

2. The system of claim 1, wherein the proxy module 
forwards the streaming media from the second streaming 
media source to the network server module while the 
network server module signals streaming media from the 
first streaming media source to the plurality of client termi- 
nals. 

3. The system of claim 1, further comprising a memory 
that stores streaming media forwarded from the proxy 
module for the network server module, the network server 
module accessing the memory to receive the streaming 
media forwarded from the proxy module. 

4. The system of claim 3, wherein the proxy module 
forwards the streaming media from the second streaming 
media source to the network server module while the 
network server module is accessing the streaming media 
from the first streaming media source from the memory. 

5. The system of claim 1, wherein the plurality of stream- 
ing media sources coupled to the network each include a 
proxy module to receive streaming media from other stream- 
ing media sources to facilitate large scale proxy streaming 
media delivery. 

6. The system of claim 1, wherein the switching terminal 
is an administrator for the plurality of client terminals. 

7. The system of claim 1, wherein the switching terminal 
is one of the plurality of client terminals that receives 
streaming media from the network server module. 

***** 
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